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SUyfiaARY OF THE IMVENTiON: 



R^t O OF THE iN^OT-iOr^: 

Itis irwentiori reiates lo dsta networks and more 
particuiaiiy fsiates to a mufticasl protocol for iocating, 
paling and leaving a rauUieast group thai is receiving 
partcuiar fr^formation. 

BACRGRDU^^D O?" TH£ INVENTSON: 

Presently g -^sei assocjaiod SM>th d rnullirnodia tor- 
fT5!nai, e, g , a conventionai worKstat ion or PC. may enter 
a request vsa {he ten-ninal to participate sn a particular 
event, e.g., alecttire, audovidao conterencs, tetevised 
speech, etc., that is besng provided by a node. e.g.. a 
packet svyisch, m a dfgitai rsetwork. The event is typically 
associated with somety.De o! identiner, i.e., group iden- 
tifier (e.g., 800 number or comerencs bridging riumbe.' 
in convsntiona! telephone networks) so that a user who 
wants to participate in the event may ideritity ths event 
in a request that ths user submits io h:s/!-ier t&rrninai 

sociated serving node within ths digital netwofk. .A croup 
identifier inay represent a coilection of (.isers who are 
iiniei'ested in paitiCiiiar infoirriation associated with the 
event. {Note that group laentifier is different trom an 
identifier that ts used to loentify a particular ijser) Typi- 
caliy, the membership associated with a group identifier 
may be dynamjc such tnat a member may join and leave 
the group at any time Also ti-^etc no restriction on the 
physicai location of mu iic.js; gro:..-p members vsrtio may 
Of may not be at the same physical iocatioa The net- 
work maintains informatior^ relating to the group and typ- 
ically does this by constructing a network directory 
which is used to track the eonnectivity of active rrsem- 
bers. Thatfs. a serving node: submits the group identifier 
to the nstwortc directory. The directory: in turn, returns 
the address of the nearest node which ft can join. The 
serving node ihsn sends a request to join the multicast 
group to the identitted nods, A node that joins or leaves 
a multicast group must notify the directory so that it can 
update the membership infonnationf. UnfcMlunately, 
men*ership may change so trsqti«ntly that manage- 
ment of such a directory may became costly and ineffi- 
cient. 

The network may also maintain such rfjombersnip 
by ccrsstructir^g a i-nuiitcast server in the network- Data 
that IS sen! by a user is then first delivered to the server, 
which, intijrns, delivers the intormatiof^ to ail other mem- 
bers in the multicast group. Although thss approach ap- 
pears to be Simple so implement it, nevertheless, may 
lead to a single point of faiiu re iiT ths event that the server 
fails. Moreover, ihss approach does not use the network 
resources sfftcientiy, since user data hfis to be (sent to 
the sefvsr. 



The loregofog is addressed and the reievani a^; 
advanced by providing an efficient and scaloatMs; mech ■ 

5 anism for a data network to maintain muitic; i^si group in ■ 
formation in a distributed fashion in which issiy tmie iri 
the network rnay aulomatically locate, join and leave a 
multicast group. The mechj^ism is distributed so that a 
single node has to maintain compiete information about 

10 ths other participants of the mtilticast group. In particu- 
lar, in accordance with an illustrative embodiment of the 
invention, a network node enters a .''equsst to pin a mul- 
ticast group, by constrtictsnq at least one routing tree 
formed from selected paths to each of a nUiTibsr of othsr 

'■5 nodes identified in ths tree and sending a tind message 
identifying the multicast group to the selected nodes in 
accordance wilh the routing tree. In response to receipt 
of a niessago idc;;-it:iying the nearest node connected to 
tn;; 'Tiu i.cijst group, ihe requesting node then simply 

20 j.cncr, fs |o " rr'.esstsge to the identified node to join the 

" ! .liv. o.fi.'-' cispecis of ihe claimed invention 
are disciosad in the ensuring detailed description, ac- 
cornparjying drawings and claims. 

SRIEF DESCraFnON OF THE DRAWiNGS: 

in the drawing: 

30 FiG. 1 shows a coiTimunications network ii^i which 
the principies of the invention may be practiced; 

RG, 2 illustratss:a routing tree rootedata particuiar 
one of the riodes of FIG, 1 ; 

3S 

FIG. 3 shows a state diagram illustrating the oper- 
ation of a node in accordance with the principles of 
the invention; 

40 FiGs. 4-g are respective expanded vergbns of the 
operaticsis states shown in FIG; 3, and 

FIGs. 1 0-1 5 illustrate the operatiorj of the principles 
of the ir?vention In an ilSustrative hierarchical net- 
work. 

DETAiLED DgSC.RiPTSOS^: 

Our inventive protocol supports what we call a "Par- 
se ticipant-initiated Join", in which a node srjitiates a re- 
quest to pin a mijttioast group and. in doing so. deter- 
rnines ihe networK patti tt^at is to be used to join the mul- 
Licasr. Tins prot>:x;oi has two phases. We call the first 
pna.'ss tne 'Fi-id" phase, since ft is the requesting node 
55 tiat determines the identity of the nodes that are already 
on the multicast ties We can the second pi-iaso -tie 
"Join" phase, since the requesting i'lods attempts to pin 
the nearest node that is already on the mijlSicast -riie in 



ine Find pnase, a node that wants to join tf-se irsyltKa^st 
group oflQinaSes a REQUEST message and sends it to 
ali of lis neighbors an the shortesi patti tre€s rooted at 
the requesting node. A neightorthsi receives the mes- 
sage then forwards it downstream to its n&ighbors along 
the links of the shortest path tree raotod at the originat- 
ing node. This process continues until the REQUEST 
message reaches either a node that is already on the 
sTUjfticast tree or a leaf node of the shortest path tree 
rooted at the originating nods {i.e., the node ttiat has ttie 
soiJShi -aftsr muiUcast information.) Each node that is al- 
ra=ady on (ho muiiicast !rss rspHes to the request, with 
the cost parameter set to 0. The ieat nodes that are not 
OR the multicast tree reply to the request with the cost 
parameter set to -1 . On feceivirsg all of the replies to the 
message, a node dsiermirjos the neare.si nods and for- 
wards the REPLY message trom the nearest node up- 
stream towards ihe originator of the REQUEST Before 
doing so, the rsode updates the cost function to reflect 
the cost from this node to the nearest node. The origi- 
nator receives a!i the replies and astsrmines the nearest 
node. Thss ends the Find phase In the Join phase, the 
requesting nodo determines the path to the nearest 
node and sends a JOI N-REQ message. The determined 
path is inserted tn the message so that an iniermediate 
node doss not have to make the sair-ie determination. 
The nearest node (having the sijtjght-after inkirmaiiOin) 
replies with a JOiN-ACK rnessags and ail the nodes fn 
the path become a brsncn of the nsulticast tree. 

An iifustrative eKample of the foregoing is shown in 
FtG 1 in which sought-after mutticast infwmation is as- 
sumed to be a n-iyltimedia svent 150, e.g., a televised 
teetLffe. Muflimedla signals characterizing the multime- 
dia event are supplied to node 105, ■mich may operate 
as a conventional video server for the purpose of sup- 
plying the video signal in the forni: of digital signais to a 
user who has entered a request to receive a cc^y of 
such signals via network 100 formed from data nodes 
106, 110, 115= 120, 125, 130 and 1!^. In an iiiustrative 
embodiment of the invention, each of the nodes may be, 
for example, a convcntioiiai ATM switch. Assume lhat a 
user associated with worj^station 170 in a conventiona! 
manner enters a request via a keyboard (not shown) to 
view the event on monitor 175, in which the request in- 
cludes an identifier associated with the muStimsdia 
event. The request, however, does not contain the iden- 
tity {e.g., address) of the source of the muiticast sniar- 
mation. Workstation 170, in response to receipt of the 
request, converts the request in!o a form escpected by 
associated network node 125, ai.so shown as the E 
nods. As an aspect of the invention, networt^ 100 doss 
not include a directory identifying the information that :s 
respectively supplied by the network 100 nodes .Ac- 
cordingly, to locate the node that has the muUicast li-v 
formation, node 125 wit! poi! each of the other network 
100 nodes. Before doing so, however, node 125 con- 
stnjcts rt troo io:n-iOd irom setectod paths to e&ch c; ;>-:c 
other nodes, in whict i ihs selection is based on precje- 



tsnnined parameter, for example, cost, number of hops, 
etc. In an illustrative omfDodiment of the invention, cost 
is chataclerfzed by a weight vaius. Sijch weight values 
are shown in parentheses in FIG. 1 and are used, as 

s mentioned, to identify a ieast cost path/route. For exam- 
ple, if nods 120 (D) needs to send a message to node 
10S (A)i then node 120 will likeiy send the message via 
node 110 (8) since the sum of the weights associated 
with the links in that path is less than the sum of She 

10 weights associated with the links in the via node 115 (C) 
path, i.e., (5) ■^ {1) < (6) -)- (3). 

TliUs. in accorcfcince with known iechniquss, node 
1 25, in the "find" phase, constructs a path tree and uses 
that tree to control the .^outing of a message to locate a 
node thai has the requested muUicast information, i,e,, 
the televised event 150. .An exampie of such a tree is 
illustrated in FtG. 2, Node 1 20 thus sends a "Find" mes- 
sage to node 1 35 (G) and to node i 20(D) m accord with 
the tree. The "Find" message includes, inter alia, thead- 

20 dress ot the message ofiginator, ideniitier associated 
With the sought-after information, a requeist tor the iden- 
tity of the nods that has the sought-after information. 
The iTses.sage may also include informaiion characteris- 
ing the constructed p-^th tre-3- .Accordingly, then, upon 

ss receipt of the rncssacje ncae 1 35 returns a Repiy mes- 
sage With the cost DarajTielcr set to ,A.ithough node 
120 does not have the soughi-aftsr information, it doss 
not discard the message since the path t.ree indicates 
that the message should be individualiy routed to nodes 

30 110. 115 and 130, as shown in Fi<3 2. Simstarfy, when 
the message reaches node 1 10, the node does not dis- 
card the message (even though it doss not have the 
SDught-afisr informaticai), but forwards It to node 105 
(A). Since, it is. assumed that nods 1Q5 has the sought 

35 after information, then it re^onds to the received mes- 
sage by returning to ncde 125 a reply message contain - 
ing the identity (address) of node 105 and with th© cost 
parameter set to Q. 

Upon receipt of the latter msssage, node 125 enters 

'fo the •Join" phase, as discussed above. In this phase, 
node 125 consfiiucis the: shortest path to node 105 and 
sands a Join messagaccwttaining the node 1 25 address 
with a request to join the rj-suiticast of ihe identified event, 
fiefemng to FIG, 2, it is seen that such p.ath would 

■^5 be via nodes 110 and 120. rather than via nodes 115 
and 1 20 Mode 105 returns a Join-ACK and then starts 
siijppiytnq thf! teieviacd sve.nt to node 1 25 via the deter- 
.-nirjed p.yih. When nodes 110 and 120. which are in the 
path of the multicast, start receiving the multicast infor- 

so mation then they note in their respective internal mem- 
ories that they also have such information. 

.Assume at this point that a user associated with 
i-^^ode 1 30 also wishes to receive the multicast and enters 
a l eausst tor that intormation. Similarly, nocie 130 con- 

Si-' stfucts a ieasi-cast path tree and faunches Its own find 
iriess.-age ■?■! accordance with the tree (not shown). When 
ihe massage Ksachss node 1 20, it !-asponds with a reply 
message to I'KKie 1 30 irsdicating t-iet it has the informsi- 



lion. As discussed above, node E 30 accumuiates the re- 
ply messages and then determines irom those message 
which oi lh0 nodes having sought-after information 
is closest to node 130. !n the present illustrative exam- 
ple, the closest node for the desired purpose would be 
node 120. Accordingly, then node 130 may join the mtii- 
ticast by sending a Join message to node 120, rather 
than to nods 1 05. "Riijs, when node 1 20 receives a pack- 
et 0} such information froni node t10. it sends a copy to 
node 125 and a copy to node 130. 

!f at this point, the user at workstation 1 70 enters a 
reqiJGst to ;fi;frr)!n;st(s reiceipt of ihs miiiticast, then node 
1 2.5 forms a "Leave" message and sends the message 
to node 120 in accordance with the constructsd path 
Ires rooted at node 125. When node 120 receives the 
message, it stores the message In iocaS merrxjfy and 
termina-es the supplying of the multicast informaticxi to 
node 1 25 but wiii continue supplying that information .as 
it is received io node 1 3Ci. 11 priof to the end of the tele- 
vised eveni, node 130 Saunchea a "Leave" message, 
then node 120, m response to !ha! message and in re- 
sponse to having no other receiver for the muttlcast. 
sends a message to node 1 1 0 to serrninate the supplying 
of the muiticas! to node 120. Similarly, node 110 sends 
a similar ms-ssage to node 1 05 if it has no other .receiver 
for the multicast !nform,ation, 

A Situation could ari-se in which a node receives, at 
about the same time (Gaicucreniiy), Find messages 
from a plurality of nodes, e.g , two nodes To handle this 
situation and preserve the correctness of !he distributed 
pfotoco!, a node, e,g., node 125, appends a time stamp 
to a Find message, in this way, if a node, e-g., node D, 
receives concurrently "Find" message from nodes 1 26 
and 130. then it pfxacesses the Find message bearing 
the earliest time stamp and returns a Reply message to 
the node, e.g., nod© 1 30, that iaynched Itie Find mes- 
sage bearing the tatest time stamp. Then, when the least 
cost multicast path is established from nods 1 0S to node 
120, then node 130 launches a Find message after wait- 
ing a random (or a predetermined) period of time and 
then proceeds as discussed above. 

in an iilustrative embodiment of the invention, the 
principles of the invention are embodied in a state ms- 
chine which is implemented in each network node for 
each multicast group. An iiiuslrativs example of such a 
state machine i-s illustrated in FiG. 3 and is composed 
of five major states, namely IDLE 301 , WAIT 302. TEN- 
TATIVE 303, ACTIVE 304 and RETRY 305. Before dis- 
cussing FiQ. 3, It would be best to .fsview the difiersni 
messag8{s) that may be sent by a node attempting to 
join a multicast and the messageis) that are sent by the 
other nodes in the network in response to a rsquest to 
join a multicast sessisx!. Sriefly a riods that wa.nts \q pta 
a multicast tree/session sends a REQUEST nis.ssage, 
in the manner disci^-ssed above. The header ot the re- 
quest message contains, inter aiia, the idenii^y■ of the 
muiticass information, sender ID, and time-stamp, (it 
may also contain a retry count.) A request message can 



oniy be Of iginated by a node thai is in the IDLE state. A 
rjode sends a REPLY friessaae in lespf-nse k? ieceip- 
of a K-?EQUEST message. A REPLY message includes 
the header ir^formation of the REQUEST message and 

^ an associated cost parameter which identifies the cost 
of the shortest path from the current node tothe nearest 
r!ode that is already on the tree. The cost is updated as 
the REPLY moves from one node to another node. The 
cost Is set to -1 if there is no ACTiVE node on that par- 

fo ticulaf path, A node sends a RETRY message if it de- 
termines that another request is aiready being proc- 
essed, as discussed above. "I he request with the eariier 
time-stamp is allowed to continue while a RETRY mes- 
sage is sent to the originator of the request having the 

'i' iater time stamp, as mentioned at)ove. A node sciiids a 
JOIN-REQ message when it wants to join the multicast 
session/tree. The pa!h to the nearest node is encoded 
within this message. An AOTIVS node sends a JOIM- 
.ACK message in response to receiving a JOIM-REQ 

^0 message The receipt of this message indicates that a 
node is on the multicast tree. A node sends a LEAVE to 
an ACTIVE neignDor node when it wants to leave the 
muiiscast sessionyirss. 

Turning then to FIG, 3, Briefly, in the IDLE state a 

2& node has no information pert>9!ning to the multicast in- 
formation (or tree). A node enters the WAIT state after 
if has sent/forwarded a fTEQUEST message and ss wai! - 
ing for a response A node enters Ihe TENTATIVE at.ate 
after if has sent-'lorwarded a .JOil''\i-REQ message io- 

30 wards the nearest node that is already on the inulticast 
tree. In this state, the node is waiting for a JOiN-ACK 
message. A node enlef^ the ACTIVE slate whsrt it joins 
a multicast session {i.e., it is on the multicast tree. A 
node reaches this state when it receives a JOiN-ACK 
message f rcma node that is aiready on the tree. A node 
in the ACTIVE state may also maintain the tree^jased 
informatton regarding ai! the links that are incident or> il 
and belong to the tree. However, the nods does r?ot 
maintain any state information about new requests to 

^0 pin the tree, A node reaches the RETRY state when it 
is the originator of a REQUEST to join a multicast tree 
and receives a RETRY message via one of the Hnits of 
the tree. In this state, a node does not have to maintain 
a.ny state information reialing to other requests. Also, 

•^■5 the node waits for a random period of time before rs- 
sending the originai REQUEST !t iTiay also tracf? the 
number of REQUEST messages thai li send,=5 

An expanded version of the 1D!..E stale is shovvn in 
FfG. 4. As mentioned above a node initiates a RE- 

50 QUEST message when it is in the IDLE state. 

A nr>de in this state only can initiate a REQLiEST 
message. A REQUEST message is identified using the 
t'.fpis <s8nd8riD,fjme-s!amp,retry-count>, where -send- 
8: !D !s the ID of the node -hat is the originator of the 

5^ message, time-stamp is the value ol a counter at the 
senderlD and retry-count is the number ot attempts the 
node nas made to join the tree. The fstry-<:oun! is initially 
0. The initial REQUEST message is ksrwarded or. all the 



links via the shortest-path tres rooted at the originating 
node. TOe node then enters tee WAfT state. Tiis Miow- 
ing aetions are taken wh&n the node rscsives either a 
REQUEST message (action paih 401) )or JOIW B£Q 
message (acfion path 402). For example, assurne thai 
a REQUEST massage is received from node B, and 
therefore contains the tuple <iDg,CNTRg, RCq>. Then 
the i-eceivihg node ta!(ss the foiSowing actions: 

If the message is not on the shortest path, then send 
a R£PL¥ vim cost = -1 towards the priginatof. Else, 
update the time startip (loea! cotjnter). 

&&m the state information oi the message. 

Forward the REQUEST message. Chang© State = 
WAIT. 

If hdavaiiabte link, send RS PLY with cost = -1 , State 
= IDLE. 

If a JOIN-REQ message is received from node B, 
then gie receiving nod^ proceeds as foibws; 

Forward JOI N-REQ message to next node. Change 
State = TENTATIVE. 



Its lin ks, then the node takes ihs following actions {pati 
502): 

ignore ^e REPLY message if it does not contain 
s state informaticjh. 

If not the tast reply, then store the cost infofrrsatipn 
and wait for other reply messages, 

to If the last REPLY, then determine best message by 
minimizing fh® (cost field of message + link cost}! 
TTien forwatri the best message towards the origi- 
nator of the REQUEST after updating cost. Change 
state = IDLE. 

IS 

If originator of REQUEST message, then compute 
the shortest path to the nearest node. Send JOIN- 
REQ message towards that node via the shortest 
path Change state TENTATiVE. 

if the node receives a RETRY messJige via one of 
fts iinks. thQnihe node fakes the followftg actions {path 
0Oi , FIG. 6): 

ss ignore the RETi=iY message if it does not contain 
state information. 



If current node is the final destination: noted in fie 
msssago, then return a RETRY message to: the 
origiriatdr: (Nc4s that this ciOTdition may arise if tie 
node changes its state from ACTIVE to iDLE dyri.ng 
the time between the sending of the REQUEST 
message and JOIN-REQ message to node B.) 

An expanded version of the WA!T state is shown in 
FIGs. SA, SB and 6. For FiGs. iSA and B , assume Siat 
a node received a REQUEST message containing the 
top!© <ID^<C!*»JTR^,RC^> from node A, 

If the node also receives a REQUEST message 
from node B, <iDB,CNTBB>RGB>. Then She node lakes 
the foitowing actfons (path 501 ); 

Update the local time stamp counter. 

If She message had not been received via ti-ie short- 
est path, then send a REPLY So B, setting cost io -1 , 

If the message is received via the shortes;! fuiih and 
A precedes B in time, then send a RETRY message 
toB. 

II the message is f eceived via the shortest path and 
B pfscedes A in time, then sersd a RETRY message 
to A. Clear state Information pertaining to A. Save 
information pertaining to B and forward REQUEST 
message. 

if the nods recstves a REPLY message via one of 



Clear the state informatic«i and forward the RETRY 
message towards the originator of REQUEST. 

Change state n IDLE. 

If origtnatof of REQUEST, then: change state RE- 
TRY 

3S Increment retry couht. 

Wait for a random period of time, then rssend the 
REQUEST message: with the updated retry count 
value, (Note; TTis. sa^ne counter vaiue (CNTR) will 
-io be used io ensure fairness.) 

If the node receives a JOIN-REQ message from a 

node, e.g., node B, then the node proceeds as follows 
tpath 602, FiG. 6): 

45 

Change state TEfNiTATIVE. 

if next node infofmaSion is avatiable. then forward 
she JOIN-REQ message to the next node and send 
so a RETRY message to nods A. 

it no next node, then send a RETRY message to- 
wards the originator ot the JOiN-REQ message. 

ss An exparsdsd version of the TENTATIVE state of 
PIG 3, is s,''!Own in FIG, 7, :n which a node enters the 
TENTATIVE Staie aiXer i; receives a JOIN-REQ mes- 
sage originated by anolher ntxie, e.g., node A. if at that 
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time; the nods receri/es a REQUEST messags from 
nods B ctsntaining the tup!® <IDg,CNTRB, RGg>, then 
the rsGsiving node proceeds in the foliowing mannsr 
(path 701): 

if a REQUEST oiessage is not received via the 
shartsst path, then return a REPLY with cost - -i to 
!he originator. Else, 

Update loeai counter vaioe. 

Send RETRY msssagetowafdstheorigiriator of the 
message. 

H, on the other hand, the node recsives a RETRY 
Message, then the node takes the followng actions 
(path 702): 

If RETRY matches JOiN-REO, forward RETRY 
message back towards node A. 

Change state = iDLE, 

ignore it RETRY message doss fiot rna!oh JOIN- 
REQ. 

if the node otherwise receives a JOiN-ACK Mes- 
sage, then the node lakes the following actions (path 
703): 

Changia State = ACTIVE. 

Forward Join- Ack to hods A. 

Clear a!! state Information. 

Update rt^uiticast tree information to include the link 
over which the JOIN-REQ was received: 

An expanded version of the ACTIVE; state of FIG. 
3, is shown in FIG: 8, in which a node is already ori the 
muiticast tres. In that case, tfie nodedniy responds to 
new requests and join requests. Other messages may 

be ignored. 

If a node in the active stats recedes a REQUEST 
message from node B containing the tuple <l[:^,Ghi- 
TRg, R!5g>, then the rsesiving node takes the following 
action (path SQ1): 

If the REQUEST message is not received via the 
shortest path, then send REPLY niessage with cost 
-1 >.a the originator. Else, 

Update local counter value. 

Send a REPLY w/iih cost = 0. 

If, on the other hand, the node recesvss a JOIN- 



RE<3 messags from nods B, thsn im node returns a 
JOIN-ACK message to B (path 802), If the node other- 
wise receives a LEAVE msssage from node B. then the 
node takes thfe following actsons: 

5 

Update multicast tree information. 

If only one ACTNB neighbor and the node is not 
member of multicast group, then send LEAVE mos- 
Ti? sage to neighbor. 

Change state !DLE. 

An expanded version of the RETRY State is shown 
IS inFIG 9 Anode enters the RETRY state ansr ssndii^g 
a REQUEST message. Assume that node A is in the 
reiry state and the associated tuple information is -- 
<ID;^,CNTRa,RC,.^.v. and that node A receives a RE- 
QUEST rncssago Irorf! node? 3 whose tuple information 
so is <ti:3s,CNiTRs,RCEj> For thai case, rsode A takes the 
ioiiowing actions (palh 901 ): 

It message is not on the shortest path, send a RE- 
PLY back with cost set to -1. Update local counter. 

II A piscecst S in tirne. then send a RETRY mes- 
sage towards node B. 

If B precedes A m tims: thsn save 8's state intor- 
30 maiion and forward the REQUEST message. Save 
A's information and slop A's retry timer (A cannot 
join the multicast group until B has joined). 

Change state -- WAIT. (A is now waiting for S) 

3S 

if , on the other hand, a JOlN-REQ message is re- 
ceived from node B;. then the node tahes the folldwing 
actions (path 902); 

40 - Gh^ge stat^ = TENTATIVE. Forward JOIN-REQ 
rnessags to next node on the pa:Sl, 

Save A's information and wait. (A cannot resend 
REQUEST messags until S has Joined multicast 
•*s group). 

If Retry timer has expired, then increment Retry 
count and send REQUEST message containing the 
following tuple: 
so <iDA,eNTRA,ReA>. The old value of onTB;^ is 
used to ensure fairness. 

Ths torsgo:ng may be readily implemented in a net- 
work torrned Trom a plurality of so-caiied Peer groups, 
ss in which a peer group is a group of network nodes form- 
ing a smaller network. In particular, a large network 
!or,-T;sd from a large number of node.s may be togicaiiy 
restructured to improve t^e efficiency ot the number. 
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Such reslrticturing snlaifs forming nodes into groups 
each operating as a smallar natwof in w^ich connec- 
tion management functions are !ogica%' extsnded to 
each tevsl of th© netwwk hisrarcHy. The stale informa- 
tion is mafntained at each physical node, !n addition, s 
sach 9roup is repreisented as a logical nods at a higher 
ieyei of the hetworl'v hierarchy by a peer group teader 
(PGL), The PQL maiotains separate state information 
for that togicat nods at that hierarchical fevol. The logical 
nodes perform the same state tranisiticsis as the physica! 
nodes at ths lowest level of the network hierarchy, in 
that sense, our inventive protocol may be affiled to 
such a network with the tolbwing modificafions (exten- 
sions), 

16 

i) A Joining Node prompts (requests) its PGL to en- 
ter the "Find" phase at the next higher ieve; o! !hft 
hierarchy. At the logical level, pre-esiabhshed vinu- so 
a! connections between iogical nodes are used Jo 
send the REQUEST and REPLY inessages. During 

the "Find" phase, the iogKai ritxies may mal«e a 
transition from the ! OL E state to the WAIT state and 
RETRY state siiTiiiar to the physical nodes. -^s 

ii) It the PGL is already active at the higher tevei 
(which may mean that some other ACT! V'E node e.K- 
fsSs in ths peer-group), then this inforrnatton ts re- 
turned to the rsquesting node. On receipt ot the in- so 
formation, the requesting node executes the proto- 
col io dete-rmins the nearest ACTIVE nods within 

the peer-group, Tiie 10 of the nearest ACTiVE node 
(physical or logical) is retumed tothe lower level re^ 
questing node. If th s current level is ths lowest level, ss 
then the requesting node enters the "Join* phase. 

lit) Otherwise, the PGL recursively executes the 
above steps at higher levels until it reaches the tc^ 
level of the hierarchy At that level, the PGL entere 40 
the "Find" phase. At the end of the "Find" phase, 
the requesting riode has ths !D ot the nearest AC- 
TIVE nods (Note that this ID may either be the 
physical ID ot the node within the same psar-groLtp 
(single peer group case) or the Sogtcal I D o1 a highst « 
level node in a logical peer-group (multiple peer 
group case). 

$0 

Based on ths available topoiogicas inTcrrnation. a re- 
questing node dstermines ths path to th© nearest node. 
The path may not be compiets if the nearest --icos is a 
logical node in a higher ievsl. iogicai peer-grouo Tna 
determined path is stored in ths forrri of a Dssignaied ss 
Transit List (DTl), as discussed in the Private Network- 
Network Interlace (PNNI) specification version VO, 
availab-e fsofrt the ATM Forum, 2570 West Ei Cfsmino 



Real, Suits 304, Mountain View, Calitomia 94a4C-1313< 
which IS hereby incorporaled by reference. The DTL is 
embedded in the JOIN-RE-:(3 message betore it is for- 
warded to the nearest noiJe. On receiving a JOiN-REO 
message, a node executes She following protocol: 

1) If the node is already ACTiVE, it returns a JOIN- 
ACK message. The JOIN- ACK is returned along 
the same path (in the reverse direction) to originat- 
ing node. 

ii) Else, if the DTL stack is not empty theii the 
X)5N-R£Q message is forwarded to the next 
node based on the intormation available in the 
DTL. {Note that new paths may be added to the 
DTL by ingress nodes, as explained in the 
above-mentioned reference. Also note that the 
JOIN-REQ and JOIN-ACK messages may be 
sent on network signaling channel. When the 
JOIN-REQ or JOIN-ACK messages are sent 
acioss i^order linKs, the logicai node at the ap- 
propriate level has to be informed so that the 
logicai riode can make a -state transition to the 
TENTATIVE or ACTIVE state respectively. This 
IS dene by sending a copy, of the JOIN-REQ or 
JOIN-ACK message to the appropnate logical 
node. 

iii) If the DTL stack is smipty th>3n ths node en- 
ters the "Fii-id" phase to deleiTt-iine the riearea- 
ACTIVE node. The nearest node infoirnation is 
then encoded as DTL and the message is for- 
warded to the nearest node. 

Similar actions are taken when a participating node 
leaves the multicast group. In Ihia case a LEAVE mes- 
sage is sent to an ACTI VE neighbor node, provided that 
the participant has only one ACTIVE neighbor. The par- 
ticipant node then enters the IDLE state, Ths neighbor 
node may then fonsard the LEAVE message to its near- 
est neighbor if it is rsot a participant and has only ots 
ACTIVE neighbor. Wh&n a LEAVE message is sent 
across a border link, then a copy of the message is sent 
to the appropriate logicai node, so that the global state 
of t^ie node can be cttanged to the IDLE state. 

The extended protocol described immediately 
above may be further appreciated when discussed in 
oon|unci!on with the examples illustrated in FIGs. iO 
through 13, in which each FIG. iliustrates a network 
formed trom tnree peer groups of network nodes (e.g.: 
ATiM switches't 201 . 202 and 203. The nodes in peer 
group (a) 201 are respscttveiy designated .A.I through 

m 202 are respectively designated B.1 through B 
5 and (c) 203 ate respectively designated C.1 ttuough 
C 6. The dari'. (or tiiled in) node serves as the PGL for 
ths respective peer group in each of FIGs. 10 through 
t3. Assume for FIG, 10 that nods A.3 wants to join a 
muUicast group, and. therefore sends a request to that 
effect to its PGL (node A), which causes that PGL to 



enter "Find" phssd; ai ihc higher levsi as noicd by 
ihe eiiipse contairsino ioslcai PGLs A, B and C. Since 
PGL A ensers the hsghesl levoi, it sends s REQUEST 
message to the other membsrs of its pesr-group to de- 
termine vsrfio has the requesisd muiticast information. 
Assume that PGL A datennines that there are no mem- 
bers of the multicast in peer-groups 8 and C. This irifor- 
mation is passed on to node A. 3 and the state of nods 

A. 3 beconrtes ACTVE. The muiticast tree now consists 
of a single node A.3. Glc43alfy, the stats machine for iog- 
ical node A also makes a tramsitioo tothe ACTIVE state. 
The AGTIViv norfos si c;ac;h lave! nm shown as boxes 
in F!G, 11- The pariicspant nodes at each ssvsf are 
shown as lightly shaded boxes. 

Assume that nods C.4 now wants to join the multi- 
cast group, and, therefore sends a reqiiest to its PGL 
(node C) to enter the "Find" phase. Node C, m response 
thereto, sends a REQUEST message to logical node B 
and logieai node A. (Note that nods C may enter the 
RETRY slate if there is a concurrent Join request frorn 
iogicai nods B.) i? there are no other r»>quests, then only 
logical nods A is ACTIVE and this information is ssnt to 
nods C.4 by scgioal node C. This action completes the 
"Find" phase for node C.4. 

In the "Join" phase, node C 4 encodes a path to 
peer-group A as a DTL and forwards a JOI N-REQ mes- 
sage to poer-group ,A. The message enters peer-group 

B, across the border link {C.2--B.4). Here, nods B 4 is 
ihe ingress node and the DTL stack is not empty (step 
(ii) of the "Join" phase). Node B.4 identifies a path 
through its peer-group to peer-group A and appends the 
path to ti-ie DTL. it then fonftrards the message towards 
peer-group A. Node B.4 aiso sends a copy Ihs JOIN- 
REQ messaga to the f^GL node B.I. wtiich: mairjtains 
the global state machine for iogicai nods B. Nods BA 
updates the global state machine of node 8 to TENTA- 
TIVE slate. Assume that the message enters peer- 
group A acro^ iink (B,5-A.5), The DTL stactc is now 
empty (step (iii) of the 'Join" phase). Node A,5 upon re- 
ceipt of the rrsessage enters the 'Find" phase to deter- 
mine the nearest nods that shousd receive the message, 
i.e., node A.3. St then appends the path to node A.3 to 
the DTL and foPA-ards the JOi N-REQ to node A.3. Node 
A 3, being ir; the ACTIVf} stats, t «-plies to receipt of the 
message by returning a JOIM-AOK mes-siage (step (i) of 
the "Join" phase). The JOIN-ACK messages retraces 
the p.sfh fcsllowed by the JOiN-.RGQ message. When the 
JOIN-ACK crosses the border Isnii (A.5-B.S), the state 
tTiachifje of logical node 8 is updated to the ACTIVE 
state. Logical nods G becomes .ACTIVE when the JOIM- 
ACK me-ssage is sent across link iS.4"C.2!. The rssiiSt- 
ing multicast tree is shown as dotted lines sn F!G. 12. 
Node B.2 can now join the muiticast tree by pining nods 
B.4, as shown in F!Q. 13. 

If participant A.S leaves the muJlicast grouo, tr;sn it 
sends a LEAVE messaoe to nods A. S. whsch prooagates 
the rr!sssag>3 to node B.S. Node .A.& asso sends a copy 
o! ih-j i..[v,AVE rxsH.. y-" o r'odt A 1 -^o tnat iho gob-il 



stats machine of Iogicai peer-group A may be ciianged 
to the IDLE stats. Node 3.5 aiso sends a LEAVE mes- 
sage to node B.4. However, the propagation oi the latter 
message stc^s as r^ods B.4 since that node has two AC- 

5 TIVE neighbors, nodes B.1 and C.2. The resulting tree 
is shown in FiG. 14, Assume now node B.2 similarly 
leaves ihe muiticast group. In friis instait the LEAVE 
message prof>agates to nods G.4. Recaii that when the 
LEAVE message is sent across linit B.4--C.2. a copy is 

10 also sen; to nods 8.1 so that the gloha! state machine 
for the peer-group may be changed to IDLE state. The 
firjai tree consisting of oniy nodeC.4 is shown in FiG. 15. 



1 , A method ot j0in;ng a rnuftieast connection originat- 
ing from a source node distributing multicast infor- 
rnaiion. s.-;(id muistcsst connection being established 
in a n6!v»o,'k cors^posed of a plurality of communica- 
tions nodes, said method comprising the steps of 

ai one of said nodes, responssve to receipt of a 
requ8.st to receix'e said inuiticast inioriTiatton. 
constructing at least one routing tree formed 
frorn selected paths to each of a number of oth- 
er nodes idsntiffed tn the tree and sending a 
message identifying said infonmstiosi to the se- 
lected nodes in accGfdjyice with the routing 
tree, and 

at said one node, responsive to receipt of a 
message identifying said source node as being 
the originator of the idenUfied information, 
sending a message contafning a request to join 
muiticasi distribution of the idenfifisd informa- 
tion. 

2, The method of claim 1 further ccmprising the steps 
of 

at the source node, responsive to receipt of a 
message containing a request to join the multicast 
distribution of the identified information, returning 
an Hcknowtedgment message to the originator of 
the message. 

a. The method of claim 1 further eomprising the steps 



at the source node, responsive to receipt of a 
message containing a i-equest to join the rr.ul- 
ticast aisrribution of the identifiea information. 

^.i.t'ik tvoii<j<i '.ae rooted d' tne 
:»ot K t ! oc - i:^ idi " K-i tne p>jde origi- 
nating the message, and 

suppivinq the miJhicast information via the path 
tree roattxi at she source nods. 



The method of 3 wr-.srsiri S3;d muiticasl tree 
inciudes at one in1errn«alate node sstweeri the 
source node and the node of iginating the message 
and wherein said method further compiises the 
steps ol 



A method of joining a muiticast connection originat- 
ing from a source node distributing muiticast infor- 
stiatson, said sTfuUscast connection being estaDiiShsd 
in a network ccmposed of a plsjrj-ihty of cc-T;imi inica- 
tions nodeS: said method corriprsinc; ine stops of 



at the intermediate node, responsive to receiv- 
ing from another one said nodes a message 
containing a request for said muiticast informa- 
tion: retiiming to said other one of said nodes 
a reply message indicating that said Intermedi- 
ate node can supply said mu tost information, 
and 

at said other one of said nodes f.iccumulalmg 
all reply messages io its reqijosl for im multi- 
cast inforfnalion arid determining ■<fiih\ch of 
nodes returning a reply messaQe is closest to 
said other one of said nodes, and 



at a networl^ node, f sspcxisive to receiving from 
first and second other ones of th© nestwork 
nodes respective message tequests to join the 
muiticast, determining as a function of a prsde- 
tem«ned parameter, which one of the first and 
second nodes is to be connected first to the 
multicast connection and sending a wait mes- 
sage to the other one of the first and second 
nodes, 

forwarding the message received from said one 
of said first and second nodes over a path con- 
t^jined m that message, and 



sending a message to join the muiticast to the 
determined closest on© of the nodes that re- 
tu rned a reply message to sasd other c»ie of said 



nodes, 



thereafter, responsive to receipt ot mutticast in- 
tormation from a source via a path lOoted at the 
source asjppiying She multicast inforiTiatioo to 
isciid one oi said first and second nodes 



The method of claim 4 lurinsr comprising the step of 
at the ciosest one of tns nodes, responsive to 
rscespf of the joiti message and thereatSsr fespon- 
sive to receipt ot nriutlicast informaiion via xhs path 
tree rooted at the source node, sending a copy of 
the received mutticast fnforjnation to the other one 
of said nodes. 

The method of claim 5 wherein said intermediate 
node fs said closest one of the nodes and whsretn 
said method f urther corrvorises the steps of 

at said intermediate nods, responsive to re- 
ceiving from said one node a message acidressed 
to said source node and requesting a termination of 
the sendirig of the multicast information to said one 
nods, terminating the sending of the multicast infor- 
matioR to said one node and continuing to supply 
ihe muiticast information as it is receivedto said oth- 
er one of said nodes. 

The method of ciairn 5 wherein said intermediate 
nods is said ciosesr one of the nodes and wherein 
said methcxi further comprises the steps ot 

at the mtgrmsdiate node, responsive to re- 
ceiving from .said other one of said nodes a mes- 
sage addressed to -said sourco nods and requesting 
a lermination of the sending of the multicast infor- 
mation to said other one of -said nodes, terminating 
the sending of the multicast information to said oth- 
er one of said nodes, and resporssive to having no 
other recipient for said muiticast information, send- 
ing the received termination message to the source 
node. 



9. The method of claim 8 further comprising the si 



response to receipt of the wait message, wait- 
ing a predetermined period of time, and 

at the expiration of that period of tiiTie again 
sending a rrwssage requesting receipt of the 
muiticast information. 

1 0. The method of eiaim 9 forttier csomprising the step of 

at said networlc node, responsive to receipt of 
the request message from said oUier one of said 
first and second nodeSi suppiying said muiticast in- 
formation to said other ona of said first and sscor^d 
nodes as it is received from the source. 

11. Th9 method of ctaim 9 further cOTiprising the steps 
of 

at said network node, responsive to receiving 
from said one noite of said first and second irodos 
a message addre&sed to s^nd souice node and :e- 
questing a termination of the sending of the muiti- 
cast information to said one of said first and second 
rvodes, terminaiing the sending of the multicast in- 
formation to that node and contsn-^ing to «.-;jppiy tt-sj- 
muiticast tnformaticfi as it is received to said other 
one of said first and second nodes. 



12. The method ot clairrs 9 fuili 



lomprising th© steps 



i^t said network node, responsive to receiving 



frcMTi said other one of said first and second rtodes 
a miessag© addressed to said soyrce node and re- 
qussting a termirjatiort of the sending of the muH\- 
cast information to said dher csie of said first and 
second nodes, ternriirfating the sending of the mul- 
ticast informatitsi to said that node^ and responsive 
to having n© other recipient for said multicast infor- 
rsiation. sending the received message reqaesting 
terffiinatio^n to the source node. 
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1. C1a1sfis: I-? 

Het.f'iOd for joiJil^g a multicast connection. Receiving a 
r4;qui'5.t to rsc«ivs Hfu it iciist infofsaatlon. Constructing a 
ri>utln<^ tree snd seoclny svsssage' to selected nodes in 
scccrdsnce with ths routing tree 



2, CI alius ; 8-12 

Method of JolnlnQ a inulticast connection. RecelviTig a join 
^iessage frm a first and s&coRd node. Oependirsg on a 
pr&detsrm-fned parameter connseting one node and sendlfig a 
watt message to the second node. 



